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DETAILED ACTION 
Specification 

1 . The abstract of the disclosure does not commence on a separate sheet in 
accordance with 37 CFR 1.52(b)(4). A new abstract of the disclosure is required and 
must be presented on a separate sheet, apart from any other text. 

Drawings 

2. The drawings filed on Jan 04, 2005 are objected because item C2, C4, R5, V4, 
R2 of Figure 3 are not mentioned anywhere in Detailed Description section of Figure 

3. Appropriate correction is required. 

Claim Objections 

3. Claim 11 is objected to because of the following informalities: line 2 has the 
misplaced character "a" in the sentence "A method according to claim 3, wherein the 
source parameter represents at least one a of the following entities". Appropriate 
correction is required. 

Claim Rejections - 35 USC § 112 

The following is a quotation of the second paragraph of 35 U.S.C. 112: 

The specification shall conclude with one or more claims particularly pointing out and distinctly 
claiming the subject matter which the applicant regards as his invention. 

In addition, 35 U.S.C. 112, sixth paragraph states that a claim limitation 

expressed in means-plus-function language as described in re Donaldson Co., 16 F.3d 

1189, 1195, 29 USPQ2d 1845, 1850 (Fed. Cir. 1994) (in banc). 

"shall be construed to cover the corresponding structure,, .described in the 
specification and equivalents thereof" "If one employs means plus function 
language in a claim, one must set forth in the specification an adequate 
disclosure showing what is meant by that language. If an applicant fails to set 



Application/Control Number: 10/520,199 Page 3 

Art Unit: 2109 

forth an adequate disclosure, the applicant has in effect failed to particularly point 
out and distinctly claim the invention as required by the second paragraph of 
section 112:' 

4. Claims 1-18 are rejected under 35 U.S.C. 112, second Paragraph, as being 
indefinite for failing to particularly point out and distinctly claim the subject matter which 
applicant regards as the invention. Furthermore, claim language lacks antecedent 
bases, and such lacking could lead to broad and/or inaccurate interpretation(s). 
Examiner treated all claims as well as understood. 

Regarding claim 1 , the phrase ''the source parameter'' on line 4 is not 

distinguished whether or not it is the same as "af least one source parameter"' on 

line 2. Examiner suggests using "said at least one source parameter" instead. 

Furthermore, claim 1 is a method claim and there is/are no step(s) mentioned 

along with it. 

Regarding claim 2, the phrase "the data object' on line 2 is not clearly 
distinguished whether or not it is the same as ''data object " in claim 1 - line 1 or 
"the object" on line 2. 

Regarding claim 3, the phrase "the value of the source parameter"' on line 
2 is not clarified whether or not it was the same as "a value of the source 
parameter" on claim 1 - line 4. Examiner suggests using "said value of the 
source parameter" instead. The term "the criterion" on line 1 is not clarified 
whether or not it was the same as "a criterion" in claim 1 - line 4. Examiner 
suggests using "said at least one criterion" instead. 
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Regarding claim 4, the phrase ''the source parameter'' on line 1 is not 
distinguished whether or not it is the same as "source parameter" in claim 1 - line 
2 or "the source parameter'* in claim 1 - line 4. Examiner suggests using "said 
source parameter'' instead. The term "f/7e criterion" on line 2 is not clarified 
whether or not it was the same as "a criterion" in claim 3 - line 1 . Examiner 
suggests using "said at least one criterion" instead. The phrase "the creation of 
the data objecf on line 3 is not clearly clarified whether or not it is the same as 
"the creation of the data objecf that is previously mentioned on line 2. Examiner 
suggests using "said creation" instead. 

Regarding claim 5, the phrase "the criterion" on line 1 is not distinguished 
whether or not it is the same as "criterion" in claim 1 - line 4. Examiner suggests 
using "said at least one criterion" instead. The phrase "the value of the source 
parameter"' on lines 1-2 is not clarified whether or not it was the same as "a value 
of the source parameter" on claim 1 - line 4. Examiner suggests using "said 
value at least one source parameter" instead. 

Regarding claim 6, the phrase "the database" on linel is not distinguished 
whether or not it is the s;ame as "a database" in claim 1 - line 1 . The phrase 
"similar data objecf on line 5 is not distinguished whether or not it is included in 
the group of "similar further data objects" on line 4. The phrase "the similar data 
objects" on lines 6, 7 are not distinguished whether or not it is the same as 
"similar further data objects" on line 4. Examiner suggests using "said similar 
data objects" instead. The phrase "the further source parameter" on line 7 is not 
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distinguished whether or not it is the same as "further source parameter'' on line 
2. Examiner suggests using ''said further source parameter'' instead. The phrase 
"the further similar data objects" on line 7-8 is not distinguished whether or not it 
is the same as "further similar data object on line 4. Examiner suggests using 
"said further source parameter'' instead. The phrase "further classification 
parameters" on lines 8, 9 are not distinguished whether or not it is the same as 
"the further classification parameters" on line 5-6. Examiner suggests using "said 
further classification parameters" instead. The phrases "data object on line 9-10 
are not distinguished whether or not it is the same as "data object in claim 1 - 
line 1 . Examiner suggests using "said data object instead. The phrase "the 
further data objects" on line 10 is not distinguished whether or not it is the same 
as "the similar further data objects" on line 6. 

Regarding claim 7, the term "the similarity on line 2 is not clearly clarified 
whether or not it is the same as "similarity of values" in claim 6 - line 7. 
Examiner suggests using "said similarity instead. 

Regarding claim 8, the phrase "the source parameter" on line 2 is not 
distinguished whether or not it is the same as "the further source parameter" in 
claim 6 - line 7. Examiner suggests using "said further source parameter" 
instead. The phrase "the further database" on line 3 is not clarified whether or not 
it is the same as "the further database" on line 2 and in claim 7 - line 3. 
Examiner suggests using "said further database" instead. 
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Regarding claim 9 and claim 10, the phrases "similarity", "value of the 
further source parameter'* on lines 1-2 are not clarified whether or not they are 
the same as "similarity, "value of the further source parameter" in claim 6 - line 
7. 

Regarding claim 11, the phrase "the source parameter"' on line 1 is not 
distinguished whether or not it is the same as "a source parameter" in claim 1 - 
line 2. Examiner suggests using "said source parameter'' instead. The terms 
"ofafa object on lines 3-7 are not clearly distinguished whether or not it is the 
same as "data object in claim 1 - line 1 . Examiner suggests using "said data 
object instead. 

Regarding claim 12, the phrase "the classification parameter" on line 1 is 
not distinguished whether or not it is the same as "a classification parameter" in 
claim 1 - lines 2-3. Examiner suggests using "said classification parameter" 
instead. 

Regarding claim 13 and claim 14, the terms "data objects" on line 1 are 
not distinguished whether or not they are the same as "data object in claim 1 - 
line 1. Examiner suggests using "said data object instead. 

Regarding claim 15, the phrase "the classification parameter" on line 1 is 
not distinguished whether or not it is the same as "a classification parameter" In 
claim 1 - lines 2-3. Examiner suggests using "said classification parameter" 
instead. The term "the ofafa object on line 2 is not distinguished whether or not it 
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is the same as "data object in claim 1 - line 1 . Examiner suggests using "said 
data object instead. 

Regarding claim 16, tlie phrase "the criterion" on line 1 is not 
distinguished whether or not it is the same as "criterion" in claim 1 - line 4. 
Examiner suggests using "said criterion" instead. 

Regarding claim 17, the terms "data object on lines 1, 3. 5 are not 
distinguished whether or not they are the same as the previously mentioned 
"ofafa object also on line 1 . Examiner suggests using "said data object instead. 
The term "database" on line 3 is not distinguished whether or not it is the same 
as the previously mentioned "database" on line 1 . Examiner suggests using "said 
database" instead. The term "central processing unit on line 4 is not 
distinguished whether or not it is the same as the previously mentioned "central 
processing unit on lines 3-4. Examiner suggests using "said central processing 
unit instead. The phrase "the source parameter" on line 5 is not distinguished 
whether or not it is the same as the previously mentioned "source parameter" on 
line 2. Examiner suggests using "said source parameter" instead. 

Regarding claim 18, the term "the instructions" on line 2 is not 
distinguished whether or not it is the same as the previously mentioned 
"instructions" on line 1. Examiner suggests using "said criterion" instead. The 
term "a computer" on line 2 is not distinguished whether or not it is the same as 
the previously mentioned "instructions" also on line 2. Examiner suggests using 
"said computer" instead. Furthermore, the claim itself is rather broad and 
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indefinite when claiming "a computer-readable medium, comprising instructions": 
see the next section for further explanations. 

Claim Rejections - 35 USC § 101 

5. 35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or composition of 
matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the 
conditions and requirements of this title. 

6. Claims 14 and 18, as well as understood, are rejected under 35 U.S.C. 101 
because the claimed invention is directed to non-statutory subject matter. 

Regarding claim 14, "streams of audiovisual information'' is being recited; 
however, it appears that the streams would be reasonably interpreted by a 
person of ordinary skill in the art as signal, per se. Applicants specification 
provides no explicit and deliberate definition of streams, and it appears that such 
would reasonably be interpreted as representative of signal. This subject matter 
falls within a non-statutory category of invention because it is not limited to a 
process, machine, manufacture, or a composition of matter. 

Regarding claim 18, "a computer-readable medium; comprising 
instructions" is being recited; however, it appears that the computer-readable 
medium comprising instructions would be reasonably interpreted by a person of 
ordinary skill in the art as software, per se. Applicant's specification only provides 
Figure 6 as illustration for the computer-readable medium with instructions 
stored on it; however, applicant's intent was for the computer-readable medium 
to be broader than the disclosed mediums with stored instructions, it appears that 
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such would reasonably be interpreted as representative of the software, which 
causes execution of comprised instructions to occur. This subject matter falls 
within a non-statutory category of invention because it is not limited to a process, 
machine, manufacture, or a composition of matter. 

Note that software or signal does not fall within a statutory category since 
either one is clearly not a series of steps or acts to constitute a process, not a 
mechanical device or combination of mechanical devices to constitute a 
machine, not a tangible physical article or object which is some form of matter to 
be a product and constitute a manufacture, and not a composition of two or more 
substances to constitute a composition of matter. 

Claim Rejections - 35 USC § 102 

7. The following is a quotation of the appropriate Paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this Section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
States. 

8. Claims 1-18, as well as understood, are rejected under 35 U.S.C. 102(b) as 
being anticipated by Hewagamage et al. (Augmented Album: Situation-dependent 
System for a Personal Digital Video/Image Collection). 

Regarding claim 1, Hewagamage et al. clearly shows and discloses [Page 
323, Section 1 , Paragraph 4] a nnethod for classification of a data object in a 
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database (utilization of context to provide easy-to-use and easy-to-remember 
interface for the management and retrieval of digital videos / images) [lines 4-6], 

the data object having at least one source parameter (geographical 
location, time) [line 15] associated therewith, by associating a classification 
parameter (corresponding event) [lines 15-16] with the data object, wherein the 
classification parameter is associated with the data object when a value of the 
source parameter satisfies at least one criterion (pictures taken in same location 
and with insignificant time difference are grouped in same event) [Page 325, 
Section 4, Paragraphs 2 and 5]. Note that the criterion here is values of location 
and time of different pictures are equal. 

Regarding claim 2, and as applied to claim 1 above, Hewagamage et al. 
further discloses a method wherein the classification parameter (corresponding 
event) (Page 323, Section 1, Paragraph 4, lines 15-16] is associated with the 
data object (digital videos / images) [Page 323, Section 1, Paragraph 4, Lines 5- 
6] when the object is entered into the database (the data streams of camera are 
recorded in its internal memory and SIT transfers them while integrating the 
relevant situational information when the connection is established) [Page 324. 
Section 3, Paragraph 5, Lines 7-10]. 

Regarding claim 3, and as applied to claim 1 above, Hewagamage et al. 
further discloses a method wherein the criterion is that the value of the source 
parameter (geographical location, time) [Page 323, Section 1 , Paragraph 4, Line 
15] is within a predetemnined range (Sensor Agent works as a reactive agent to 
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capture the location, tinne and possible event information from a personal 
scheduler) [Page 324, Section 3, Paragraph 5], e.g., time when pictures are 
taken are within range of time from user's personal scheduling application. 

Regarding claim 4, and as applied to claim 3 above, Hewagamage et al. 
further discloses a method wherein the source parameter represents a 
geographical location of the creation of the data object [Page 323, Section 1 . 
Paragraph 4, Lines 5-6], and the criterion is that the value of the source 
parameter is such that the creation of the data object has taken place in a 
predetermined region (Sensor Agent works as a reactive agent to capture the 
location, time and possible event information from a personal scheduler) [Page 
324, Section 3, Paragraph 5], e.g., location when pictures are taken are within 
region from user's personal scheduling application. 

Regarding claim 5, and as applied to claim 1 above, Hewagamage et al. 
further discloses a method wherein the criterion is that the value of the source 
parameter (geographical location, time) [Page 323, Section 1, Paragraph 4, Line 
15] equals a predetermined value (Sensor Agent works as a reactive agent to 
capture the location, time and possible event information from a personal 
scheduler) [Page 324, Section 3, Paragraph 5], e.g., time when pictures are 
taken are exact as time from user's personal scheduling application. 

Regarding claim 6, and as applied to claim 1 above, Hewagamage et al. 
further discloses a method [Pages 325-326, Section 4, Paragraphs 1-5] wherein 
the database comprises further data objects having at least one further source 
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parameter associated therewith and wherein the method comprises the following 
steps: 

identifying similar further data objects having at least one further 
classification parameter associated with each similar data object, wherein 
the further classification parameters of the similar further data objects 
have equal values (when the user selects a particular event category, then 
icons appeared in the Map and Time Frame Components are restricted to 
be the ones in that category) [Paragraph 5, Lines 6-12], e.g., pictures in 
same event; 

identifying similarity of values of the further source parameter of the 
further similar data objects having equal further classification parameters 
(when the user selects a particular event category, then icons appeared in 
the Map and Time Frame Components are restricted to be the ones in that 
category) [Paragraph 5, Lines 6-12], e.g., pictures with similar location and 
/ or time in same event; 

associating the further classification parameter with the data object 
when the data object is similar to the further data objects values (If several 
videos and/or images are taken at the same location having insignificant 
time difference, then they are considered to belong to the same context 
and a single icon Is used to represent them) [Paragraph 2, Lines 5-9], e.g., 
same event category contains only pictures taken at similar location and / 
or time. 



Application/Control Number: 10/520,199 Page 13 

Art Unit: 2109 

Regarding claim 7, and as applied to claim 6 above, Hewagamage et al. 
further discloses a method [Page 325, Section 4. Paragraphs 1-5] wherein the 
value of the further classification parameter and the similarity as criterion for 
associating a new data object with the further classification parameter with the 
value are stored in a further database [Page 326, Figure 4] (Events Component 
in the system is used to shows event categories grouping images/video clips as a 
way to shows contextual relevancy of data object taken at same location and/or 
time) [Paragraph 2, 5]. 

Regarding claim 9, and as applied to claim 6 above, Hewagamage et al. 
further discloses wherein the value of the further source parameter (geographical 
location, time) [Page 323, Section 1, Paragraph 4, Line 15] is an alphanumerical 
string (latitude and longitude information, timing information) [Page 324, Section 
3, Paragraph 2, Lines 8-9] and similarity is identified as the further source 
parameters having equal values (icons overlapped meaning pictures taken in the 
same or nearby location) [Page 325, Section 4, Paragraphs 2, Lines 9-1 1]. 

Regarding claim 10, and as applied to claim 6 above, Hewagamage et 
al. further discloses a method wherein the value of the further source parameter 
(geographical location, time) [Page 323, Section 1, Paragraph 4, Line 15] is a 
numerical value (latitude and longitude infomiation, timing infomnation) [Page 
324, Section 3, Paragraph 2, Lines 8-9] and the similarity is identified as the 
further source parameters having their values in a predetemiined range (Sensor 
Agent works as a reactive agent to capture the location, time and possible event 



Application/Control Number: 10/520,199 Page 14 

Art Unit: 2109 

information from a personal scheduler) [Page 324. Section 3, Paragraph 5], e.g.. 
time when pictures are taken are within range of time from user's personal 
scheduling application. 

Regarding claim 11. and as applied to claim 3 above, Hewagamage et 
al. further discloses a method wherein the source parameter represents at least 
one of the following entities [Page 323. Section 1. Paragraph 4]: 

geographical location of the creation of the data object [line 1 5] 

date of creation of the data object 

time of creation of the data object [line 1 5] 

name of the creator of the data object 

data format of the data object 
Regarding claim 12. and as applied to claim 1 above. Hewagamage et 
al. further discloses a method wherein the classification parameter corresponds 
to an event (corresponding events) [Page 323. Section 1, Paragraph 4, Lines 15- 
16], 

Regarding claim 13. and as applied to claim 1 above, Hewagamage et 
al. further discloses a method wherein the data objects are still picture images 
(digital images) [Page 323, Section 1, Paragraph 4, Lines 5-6]. 

Regarding claim 14. and as applied to claim 1 above. Hewagamage et 
al. further discloses a method wherein the data objects are streams of 
audiovisual information (digital videos) [Page 323, Section 1, Paragraph 4. Lines 
5-6]. 
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Regarding claim 15, and as applied to claim 1 above, Hewagamage et 
al. further discloses a method wherein the classification parameter 
(corresponding events) [Page 323, Section 1, Paragraph 4, Lines 15-16] is 
associated with the data object (digital videos/images) [Page 323, Section 1, 
Paragraph 4, Lines 5-6] by a user (interaction of user to obtain additional 
information about the corresponding events using a voice input system, or 
guessing corresponding events from a personal scheduler application) [Page 
324, Section 3, Paragraph 5]. 

Regarding claim 16, and as applied to claim 1 above, Hewagamage et 
al. further discloses a method wherein the criterion is stored in a further database 
(Map Component, Time Frame Component, Events Component) [Page 325, 
Section 4], 

Regarding claim 17, Hewagamage et al. clearly shows and discloses an 
apparatus for classification of a data object in a database, the data object (digital 
videos / images) [Page 323, Section 1, Paragraph 4, Lines 5-6] having at least 
one source parameter (geographical location, time) [Page 323, Section 1, 
Paragraph 4, Line 15] associated therewith, the apparatus comprising a storage 
device for storing the database (data streams of camera are recorded in its 
internal memory) [Page 324, Section 3, Paragraph 5, Lines 7-8], means for 
receiving data objects (when the user takes pictures, and passes the information 
to Situational Agent) [Page 324, Section 3, Paragraph 5, Lines 3-4] and a central 
processing unit, wherein the central processing unit (Situational Agent is the 
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central agent of the system and also carries out the data management functions) 
[Page 324, Section 3, Paragraph 5, Lines 5-7] is conceived to associate a 
classification parameter with the data object (digital videos / images) [Page 323, 
Section 1, Paragraph 4, Lines 5-6] when the source parameter (geographical 
location, time) [Page 323, Section 1 , Paragraph 4, Line 15] satisfies at least one 
criterion (pictures taken in same location and with insignificant time difference are 
grouped in same event) [Page 325, Section 4, Paragraphs 2 and 5]. Note that the 
criterion here is values of location and time of different pictures are equal. 

Regarding claim 18, Hewagamage et al. clearly shows and discloses 
[Page 324, Section 3, Paragraph 6] a computer-readable medium (prototype 
system), comprising instructions, which are readable and executable by a 
computer (implementation using the Microsoft Agent software development kit, 
Microsoft Visual C++ and Amzi Prolog), wherein the instructions enable a 
computer to execute the method according to claim 1 (system enabled three 
software agents to capture the situational information to work as described in 
[Page 324, Section 3, Paragraph 5]). 



Claim Rejections - 35 USC § 103 

9. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in Section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 
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10. Claim 8 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Hewagamage et al. in view of Shiomi at al. (Pat. No. US 6,009,439). 

Regarding claim 8, Hewagamage et al. clearly shows and discloses the 
claimed invention as set forth in the rejection of claim 7 above, in addition, 
Hewagamage et al. further discloses a method comprises three further 
databases (Map Component, Time Frame Component, Events Component) 
[Page 325, Section 4, Paragraph 1-5] to store further source parameters 
(geographical location, time) [Page 323, Section 1, Paragraph 4, Line 15] of the 
data object (digital videos / images) [Page 323, Section 1, Paragraph 4. Lines 5- 
6], However, Hewagamage et al. does not specifically discloses the step of 
searching the further database to check whether the source parameter of the 
data object matches at least one criterion stored in a further database. 

In the same field of endeavor, Shiomi et al. discloses [Description of The 
Preferred Embodiments, Embodiment 2, Column 24 - line 1 to Column 25 - line 
15] a method to classify geographical data (source parameter) stored in retrieval 
data storing unit (a magnetic disk storing a plurality pieces of data and each 
piece is composed by area attribute, zip code attribute, and more) [Column 24, 
Lines 6-19]. Furthermore, Shiomi et aL clearly shows the step of searching the 
storing unit for geographical data for a character string (criterion is matching the 
search query) specified by controlling unit [Column 24, Lines 21-27]. If a string- 
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match occurs, the geographical data is not classified since the data construct 
only one group. [Column 24 - line 51 to Column 25 - line 15]. 

Therefore, it would have been obvious to a person of ordinary skill in the 
art at the time the invention was made that further database will be checked to 
confirm whether the source parameter of the data object matches at least one 
criterion stored in the further database as taught by Shiomi et al. in the system of 
Hewagamage et al. as described for easy classification and retrieval of data 
object in a database. 

Conclusion 

1 1 . The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 

Narayanaswami et al. (Pat No. US 6,504,571) teaches system and 
method for querying digital image archives using recorded parameters. 

Kondo et al. (Pat No. US 5,519,865) teaches system and method for 
retrieving and classifying data stored in a database. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Son T. Hoang whose telephone number is (571) 270- 
1752 and email is son.hoang@uspto.gov . The examiner can normally be reached on 
Monday - Friday. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Deborah Reynolds can be reached on (571 ) 272-4919. The fax phone 
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number for the organization where this application or proceeding is assigned is 571- 
273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for published 
applications may be obtained from either Private PAIR or Public PAIR. Status 
information for unpublished applications is available through Private PAIR only. For 
more information about the PAIR system, see http://pair-direct.uspto.gov. Should you 
have questions on access to the Private PAIR system, contact the Electronic Business 
Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO 
Customer Service Representative or access to the automated information system, call 
800-786-9199 (IN USA OR CANADA) or 571-272-1000. 




